Analysis of Bidirectional Associative Memory Using SCSNA and Statistical Neurodynamics

نویسندگان

  • Hayaru Shouno
  • Masato Okada
چکیده

Bidirectional associative memory (BAM) is a kind of an artificial neural network used to memorize and retrieve heterogeneous pattern pairs. Many efforts have been made to improve BAM from the the viewpoint of computer application, and few theoretical studies have been done. We investigated the theoretical characteristics of BAM using a framework of statistical-mechanical analysis. To investigate the equilibrium state of BAM, we applied self-consistent signal to noise analysis (SCSNA) and obtained a macroscopic parameter equations and relative capacity. Moreover, to investigate not only the equilibrium state but also the retrieval process of reaching the equilibrium state, we applied statistical neurodynamics to the update rule of BAM and obtained evolution equations for the macroscopic parameters. These evolution equations are consistent with the results of SCSNA in the equilibrium state.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Transient dynamics for sequence processing neural networks

Abstract An exact solution of the transient dynamics for a sequential associative memory model is discussed through both the path-integral method and the statistical neurodynamics. Although the path-integral method has the ability to give an exact solution of the transient dynamics, only stationary properties have been discussed for the sequential associative memory. We have succeeded in derivi...

متن کامل

Statistical Mechanics of Stochastic Neural Networks

The self-consistent signal-to-noise analysis (SCSNA), which was developed originally for deterministic analog neural network models of associative memory, is free from the energy concept and has wide applicability. The SCSNA can be extended so as to be applicable to the case of stochastic neural networks. When the energy concept holds, the TAP equation is shown to play an important role in deal...

متن کامل

Bi-stability of mixed states in neural network storing hierarchical patterns

We discuss the properties of equilibrium states in an autoassociative memory model storing hierarchically correlated patterns (hereafter, hierarchical patterns). We will show that symmetric mixed states (hereafter, mixed states) are bi-stable on the associative memory model storing the hierarchical patterns in a region of the ferromagnetic phase. This means that the first-order transition occur...

متن کامل

A statistical mechanics of an oscillator associative memory with scattered natural frequencies

We analyze an oscillator associative memory with scattered natural frequencies in memory retrieval states by a statistical mechanical method based on the SCSNA and the Sakaguchi-Kuramoto theory. The system with infinite stored patterns has a frustration on the synaptic weights. In addition, it is numerically shown that almost all oscillators synchronize under memory retrieval, but desynchronize...

متن کامل

Associative memory by recurrent neural networks with delay elements

The synapses of real neural systems seem to have delays. Therefore, it is worthwhile to analyze associative memory models with delayed synapses. Thus, a sequential associative memory model with delayed synapses is discussed, where a discrete synchronous updating rule and a correlation learning rule are employed. Its dynamic properties are analyzed by the statistical neurodynamics. In this paper...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2002